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MODEM RELAY PROTOCOL REDUNDANCY FOR 
' RELIABLE LOW SPEED MODEM COMMUNICATIONS 
OVER IP NETWORKS WITH SUBSTANTIAL PACKET LOSS 



g ***** 

CROSS REFERENCE TO RELATED APPLICATIONS 
Not applicable. 

STATEMENT REGARDING FEDERALLY SPONSORED RESEARCH OR 
10 DEVELOPMENT 
Not applicable. 

BACKGROUND OF THE INVENTION 

This invention relates to modem transmission over packet networks. In particular, the 
15 present invention relates to techniques for demodulating, relaying, and remodulating low speed 
(eg. V.22, V.22bis and V.21) modem transmissions over packet networks with a robust 
redundancy technique to maintain reliable communications in the event of high packet loss. 

When modem devices are connected through a packet network, they are not directly 
20 connected. The entire modem signal is packetized the a sending end, sent over the packet 

network and reassembled into a designated format at the receiving end before presentation to the 
receiving modem device. 
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For example, packetizing and transporting of modem calls over gateway platforms using 
G.711 (PCM) codec, requires digitizing the originating modem phone line at 64Kbps, packetizing 
and transporting the entire 64 kbps data stream to the other side, and then sending out the same 
64 kbps data stream to the remote modem. The advantage of this approach is that it works for 
5 any modem that can be received on a standard POTS phone line, and it is simple to implement. 

The disadvantage of this approach are: 

(1) it requires a large amount of network bandwidth to implement the call and a 
connection can be dropped because of packet loss. If G. 71 1 packets are being sent every 10 

10 mSec, then the network bandwidth required to send each direction of the call is over 1 10 kbps 
(when the header sizes (RTP+UDP+IP+TCP+Ethemet) are included). 

(2) The connection over a packet network is not a constant connection and often 
experiences line delays, errors, jitter and/or packet loss which can result in modem errors. In 
particular, packet loss results in interruptions in the modem signal (intermittent carrier loss) at the 

15 receiving modem. The interruptions result in degraded data throughput due to modem retrains 
and increased modem connection failures. 

(3) Due to the clock differences at the two end points, standard G.71 1 playout techniques 
will periodically exhibit a modem signal interruption due to playout overruns and/or underruns. 
Again these interruptions in the modem signal lead to periodic modem retrains impacting data 

20 throughput rates. 
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In summary, when G.71 1 coding with packetization is used for data modem transmissions, 
the two modems are essentially communicating to each other using a potentially inadequate 
medium for their transmission. This approach is particularly vulnerable to network packet loss. 

SUMMARY OF THE INVENTION 

The modem relay of the present invention allows for the capability to demodulate, relay, 
and remodulate modem transmissions over packet networks. 

The modem relay provides a local interface to the modem on both ends of the call, 
demodulates the fiill duplex data stream, packetizes the bits for transport over an IP network, and 
remodulates the data stream at the remote end. The modem relay provides bandwidth savings, 
and improved performance (data throughput and connection reliability) in a packet loss 
environment. 

The modem relay mitigates the problems associated with using G.71 1 to send modem 
traffic. In modem relay, the physical layer or link layer of the modem signal is terminated locally 
for both ends of the call. Only the demodulated data stream is sent over the network. This leads 
to dramatic bandwidth savings. For a V.34 modem, in an exemplary embodiment, the 64 kbps 
phone line is demodulated into a maximum of 33,600 bps data stream. That data stream is 
packetized and transported with a network bandwidth of less than 20 kbps (for 30mSec packets). 
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Since the physical layer is terminated locally, network packet loss will not result in any 
interruption in the modem signal at the receiving modem. Therefore this approach will eliminate 
connection failures due to the network packet loss. Instead a packet loss will result in an error in 
the information data stream. 



Bandwidth savings are also realized using Modem Relay in that data is carried over the IP 
network only as the modem transmits data. When the modem is not transmitting data, no packets 
are sent on the IP network. In contrast, continuous 64 kbps packetization takes place when using 
G.71 1 to carry modem traffic. Depending on the network transport, the modem data is sent over 
10 the packet network using a guaranteed delivery mechanism (link layer termination) or sent using a 
non-guaranteed delivery mechanism (physical layer termination). In the case of a non-guaranteed 
delivery mechanism, data redundancy techniques can be used to combat packet loss and improve 
data throughput. 

15 BRIEF DESCRIPTION OF THE DRAWINGS 
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Figure 1 is a diagram illustrating the components of a modem relay configuration. 



Figure 2 is a diagram illustrating a point-of-sale implementation of the present invention. 
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Figure 3 is a flow decision diagram illustrating the decision sequence for determining the 



modulation and connection speed. 
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Figure 4 is a logic diagram illustrating an exemplary logic structure for modem 
identification and modem relay activation. 

Figure 5 is a logic diagram illustrating an alternative logic structure for modem 
identification and modem relay activation. 

Figure 6 is an exemplary implementation of a DSP voice channel configuration. 

Figure 7 is an exemplary modem relay DSP configuration. 

Figure 8 is functional block diagram of an exemplary modem relay unit. 

Figure 9 is a ladder diagram illustrating the establishment and negotiation of a connection 
using V. 22 bis modems. 

Figure 10 illustrates a typical IP packet for the present invention. 

Figure 1 1 illustrates an exemplary MRU packet format of the MRU payload within the 
RTP packet of the present invention. 

Figure 12 illustrates the modem relay protocol state packets, modem handshake state 
packets and modem data packets. 
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DETAILED DESCRIPTION OF THE INVENTION 

The modem relay for V.22bis modems and below occurs at the physical layer. The 
modem's physical layer is demodulated into a bitstream and that bitstream is relayed end-to-end 
across the network. Any higher layer protocols (error correction, compensation) that may be 
present are passed end-to-end across the network. 

A typical modem relay system configuration is illustrated in Figure 1. For lower speed 
modems, a typical end-user application is in point-of-sale terminals used to implement credit card 
validation. Figure 2 illustrates a point-of-sale implementation using modem relay. 

The steps in setting up a modem relay connection are: 

1) A first user, initiates a modem call using a dial-up modem, such as modem 2 attached to 
a personal computer 1 or in a point-of-sale terminal 20, at the first end of the connection. 

2) Modem 2, enters an ofF-hook state, dials and waits for the far end modem 14 to answer. 

3) The first gateway 3 detects the line seizure, opens a DSP voice channel and collects 
DTMF digits. 

4) The first gateway 3 translates the dial number and attempts to perform a call setup to 
the far end gateway 9 which is located at a remote point in the network. 

5) Gateway 9 detects the incoming call setup firom gateway 3 over the packet network 8. 
The gateway 9 accepts the incoming call and opens a DSP voice channel to handle the incoming 
call. Next, gateway 9 seizes the outgoing line. 
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6) For modem relay, the outgoing line connects to modem 14 at the far end which may be 
connected to a personal computer 15 or may be a modem in a modem pool 24. Modem 14 goes 
ofF-hook and plays a modem answer sequence (eg. V.25 ANS tone). 

7) Gateway 3 detects the modems answer sequence (as described below) and switches the 
5 DSP over from a voice channel to a modem relay channel. Then gateway 9 sends the switch over 

message to gateway 3 in the form of a modem relay message packet. Gateway 9 also continues to 
negotiate with far end modem 14 to establish a data connection to PC 15. 

8) Gateway 3 switches its channel to modem relay and begins to negotiate channel setup 
with modem 2. 

10 9) During the negotiations, control messages are exchanged between gateway 3 and 

gateway 9 to coordinate the compression format used on both sides of the link and to establish the 
gateway to gateway LAPM link. At the end of the negotiation, both modems have connected 
with their respective local gateway at the best possible connection rate using V.42 LAPM and the 
same type of compression. Further, the modems on both sides have transitioned into data mode 

15 and are ready to begin sending or receiving data. 

10) Modem 2 and modem 14 now begin sending data back and forth across the packet 
network 8. Each gateway unit demodulates the modem transmissions, packetizes the data and 
sends it to the far side. The gateway on the far side remodulates the modem data and sends it to 
the far end modem. Throughout the connection, flow control is performed on each segment of 

20 the link to regulate the error free transmission of data. 

11) The connection continues until one of the modems hangs up. At that point, the call is 
terminated on both sides and the channels then return to idle. 



Throughout a modem relay call, the state machines in the modem relay unit periodically 
send line status updates to make sure that both modems remained in sync with each other. 

The operation of modem relay is driven by events that occur when gateway 9 seizes its 
outgoing line and places a call to modem 14. Initially gateway 9 does not know that the call is a 
modem call, and begins by using a voice processing configuration in the DSP 13. When modem 
14 answers, it begins play out of a V.25 answered tone (ANS), as illustrated in Figure 3. 

When modem relay is enabled, gateway 9 switches to the low speed modem relay DSP 
code after it detects the V.25 answered tone, and proceeds to monitor the incoming sequence 
fi-om modem 14. Gateway 9 attempts to establish a V.22bis, V.22 or V.21 data connection. 
Depending on the type of modem on the line, the decision sequence illustrated in Figure 3 is 
executed to determine the modulation and speed for the connection. If a fax signal is detected, 
the modem relay code sends a message to the microprocessor code to perform a switch to fax 
relay. 

At each stage of the negotiation process, gateway 9 will be sending signaling messages 
across the network to gateway 3. Because there is no guaranteed method of flow control 
between lower speed modems, both sides of the connection must be trained to operate at the same 
modulation and rate. Therefore, signaling messages are used to determine if the capabilities of the 
two modems can support an optimal connection. If there is a capability overlap, the best 
commonly supported data rate will be selected at both sides. If there is no modulation and rate 
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common to modem 2 and modem 14, then the call will be a connected independently at both 
sides. These "uneven" connections work, but not as efficiently as connections that support the 
same data rate at both ends. 

For V.32 modems and above, V,42 error correction is frequently used to provide link 
layer connectivity and error correction between the two modem and points. For V.22bis modems 
and below, V.42 error correction may or may not be present in the connection. 

For V,22bis modems and below, if V.42 is present, it is handled transparently by passing 
error correction end-to-end over the network. Therefore, both modems have to be synchronized 
at the start of the call to use the same modulation and data rate. Then, V.42 and other high layer 
protocols are simply ignored by the modem relay software. This approach will work provided 
that network end-to-end delays do not exceed one second. If the network delay exceeds one 
second, then the modems will be able to connect to each other but not be able to establish LAPM 
protocols across the link, which will increase the error rate and prevent data compression (V.42 
bis) for the modem session. 

There is currently no network protocol standard defining the call control or data 
transmission protocol for modem relay over packet networks. Therefore, a proprietary approach 
is utilized by the present invention to implement modem relay. However, the present invention 
can be implemented with a standard protocol without departing from the scope of the inventive 
concepts taught herein. The protocol is similar to the proprietary fax relay protocol disclosed in 



co-pending application 09/03 1,047. The modem relay protocol used accommodates 
encapsulation using the RTP format for transmission across the network. 

The modem relay protocol has the following features: 

Redundant Signaling Messages - There are two types of signaling messages: call 
control and modem control signaling. Once a modem call is established, the only call 
control message that is expected is a termination event. Modem control messages 
including events like forced retraining or carrier loss events. All of the signaling messages 
between the two gateway units 3 and 9, are sent periodically throughout the call by the 
modem relay unit. They are sent more rapidly during call setup and negotiation. A 
signaling message is contained in a single modem relay packet, which conveys the current 
state of the call. If the network drops any one signaling packet, another packet will be 
sent soon so that the call can still proceed normally. If there is a network outage during a 
modem call that interrupts the packet flow between modem relay units, each side of the 
connection will perform a clear down on its part of the call. 

Redundant data. Instead of sending the same packet several times, data 
redundancy is achieved by appending data from previous packets in the payload section of 
the current data packet. Then, the receiving gateway uses the packet sequence number to 
determine if there has been a packet loss. If no packet loss occurred, it uses the most 
recent data field in the packet. If the receiving gateway detects that packet loss has 
occurred, the data fields for lost packets are retrieved by reading fiirther down in the 
current packet. Data redundancy effectively increases the network bandwidth, though the 
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actual data from the modem is a small part of the overall packet size. For instance, in a 
2400bps modem with a lOmSec VIF size, the data size is 3 bytes and the header size is 48 
bytes per network packet. Adding in additional 3 byte data fields will not increase the 
overall packet size by a significant amount based on a percentage of the total size. The 
amount of redundant data contained in each packet is configurable. 

Retraining is also accommodated by the present invention. In the event that one of the 
modems in the connection experiences a loss of equalization on the line, it can initiate a retrain 
signal. When a gateway receives the retrain signal, it executes the retraining sequence locally and 
sends the retrain signal across the network to the other gateway. Both sides of the connection are 
negotiated to support the best case common rate. 

Since the retraining and rate signaling events may not be supported by one of the modems 
in the connection, a potential system problem occurs when one side initiates a retrain. The 
significance of this problem will depend upon the modem capabilities. If both sides of the call 
cannot be retrained to the compatible rate, the call will be terminated and cleared. 

Call discrimination is accomplished through processing in the DSP. When a call is 
connected, the gateway must determine what type of call processing is required to successfiilly 
implement the call: voice, fax relay, modem relay, or PCM. Individual channels can be pre- 
configured for a certain type of processing, but in general the gateway does not know in advance 
what type of devices are going to be involved in the call. The earlier it can distinguish the type of 



traffic involved in a call, the faster it can switch over to use the right set of processing resources. 

Figures 4 and 5 illustrate alternative embodiments for the decision tree for determining the 
processing sequence for new calls. Initially, the originator places a call were the packet network. 
Upon detecting a call, the answering gateway sees the line and goes off hook. The answering 
gateway then determines if a V.25 answer tone (ANS) with phase reversal, used by V.32, V.22 
and V.21 modems, is present. When detected on the answering side, the gateway will switch to 
modem relay processing. 

If phase reversal is not present, the ANS is the basic V. 25 answer tone used by fax 
machines and V. 32, V. 22 and V. 21 modems. When detected on the answering side, the 
gateway will switch to modem relay processing is the channel is reconfigured for modem relay 
and will not switch if the channel is potentially expecting fax transmissions. In the event that no 
ANS tone is detected, the answering gateway will then check for V. 21 flags which is the queue 
to switch to fax relay processing. If no events are detected, the gateway will to continue to 
process the call using voice codec. 

Most of the functionality required to implement modem relay is located in the DSP 
software of the gateway. Figure 6 illustrates a standard DSP voice channel configuration. When 
added, the modem relay unit, MRU, is added as a processing lock in the DSP software, figure 7. 
Modem relay channels are added to the DSP system integration unit SIU, Modem data pumps are 
added to the DSP software. Modem relay encapsulation and protocol functions are added to the 
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MRU DSP software and MRU configuration and statistics commands are added to the SIU. 

The microprocessor of the gateway also needs to be modified to accommodate the modem 
relay processing requirements. The microprocessor must respond to messages fi-om the DSP that 
instruct the microprocessor to switch over fi-om a voice channel to a modem relay channel in the 
DSP. The microprocessor must be able to respond to modem relay packets arriving fi-om the 
network by switching a voice channel to a modem relay channel in the DSP. The microprocessor 
must allow the operator to configure and query statistics on modem relay channels and must 
extend the NMM operator command set to accommodate commands needed to implement 
modem relay. 

The SIU handles control and status messages fi-om the microprocessor that reference to 
channel as it does for other types of DSP channels. Messages fi-om the microprocessor that are 
unexpected or not supported in modem relay mode v^U be returned with an error code. 

Within the MRU, figure 8, is the fijnctional software for modem relay. The structure of 
the MRU includes a modem driver connected to the PCM interface, a modem relay protocol unit 
and a modem network driver which connects to the network interface. The modem driver 
provides the interface between the PCM interrupt routine and the modem data pump, which 
performs the physical modulation and the modulation fimctions of the current modem. The 
modem relay protocol module tracks the modems control and state machine fiinctions and 
provides both data and messaging queues and overflow buffers. It also formats the modem data 



and signals into the proprietary modem relay protocol. The modem network driver performs the 
RTP encapsulation functions to implement the modem relay protocol containing signaling 
messages and data. It also provides a jitter offer to compensate for network delays. 

The establishment and negotiation of a connection using V. 22 bis modems is illustrated in 
the connection ladder diagram of figure 9. The modems will establish and negotiate a connection 
between the two gateways using the gateway communication messages to coordinate the modem 
sessions. As illustrated, the call is initially established as a voice call until the tones to establish 
modem relay are detected. The modem relay units exchanged a handshake, and appropriate 
connection is negotiated the modem relay units contact and then establish relay states for 
beginning the modem data over IP communication. 

In order to properly implement a modem relay, is necessary to establish packetization 
parameters as well as modem functional parameters such as modulation and rate. The approach 
of present invention defines the modem relay unit packet format to be encapsulated by RTP 
packets for use by compatible gateways with modem relay units. In order to establish and 
maintaining a modem connection over a packet network, the originating an terminating gateways 
must have a common modem relay unit packet format. The packet, figure 10, transported over 
the digital packet network, consists of a sequence number, kind stand, modem handshake, modem 
relay protocol and modem data depending on the process modem relay state. The packet format 
is illustrated in figure 10. 
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Figure 1 1 illustrates the MRU packet format of the MRU payload within the RTP packet. 
The illustrated exemplary embodiment illustrates a bit payload with redundancy. Because the 
modem relay unit of the present invention maintains the modem connection with the modem at 
each end of the connection, the data can be packetized into a packet with a standard RTP header 
and time stamp. Following the RTP header, blocks 25 in figure 1 1, is a field indicating the MRU 
protocol version. Identification of protocol version allows for better capability match and 
backward compatibility for more recent protocols. The digital fields in the packet include 
protocol state packets, handshake state packets and data as the exemplary packets in the present 
invention. Other protocols said packets can be included. The modem relay protocol state 
packets, modem handshake state packets and modem data packets are illustrated in Figure 12. 

In addition to establishing protocols for packetization, protocols for a method for 
established communication across a packet network between modem relay units, must also be 
established. Once a call is established across a network with acceptable network delay and packet 
loss, the modem data pumps in the modem relay units begin the handshake routine with the 
respective local modems. The modem data pumps are also able to report local connection and 
carrier loss information to the modem. 

Once a call is established across a network, both modem relay units send modem relay 
handshake message packets to the other modem relay unit. The initial packet contains the 
information on supported modem rates. The packet is repeated every 50 milliseconds to 
overcome packet losses. As soon as the first message is sent over the network, a timer is set to 5 
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seconds and started. The modem data pumps are maintained at idle during the handshake phase. 
When the handshake message is received the rate bit mask is added with the local rate bit mask. 
The highest speed is chosen from the resulting value and handshake is initiated with the local 
modem. The modem data, will be started and connected at the best possible data rate. 

If the handshake message is not received, then the timeout occurs and highest speed is 
chosen from the local rate bit mask. The hand shake is initiated with the local modem and the 
modem data pump is started. 

As soon as a local handshake is reported, the modem relay unit will send the connect 
message packet to the other side. This message is also repeated every 50 milliseconds to 
overcome packet losses. When the connect message is received, the receiving MRU sends the 
reply message packet to the other site and continues to communicate with data packets. The 
reply message is for acknowledgment purposes and is not repeated. When a carrier loss occurs, 
the modem relay unit will send the carrier loss message packet to the other side. This message is 
repeated every 50 milliseconds to overcome packet loss. When the MRU connect message is 
received, the MRU sends the MRU relay message to the other side and continues to communicate 
with data packets. This message is for informational modem purposes and will not be repeated. 

In the majority of packet networks, some packet loss is experienced. Therefore, the 
present invention includes a data redundancy technique which makes the modem relay reliable 
even in the presence of substantial packet loss over the packet network. Simple redundancy 
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techniques can recover the information contained in lost packets if a single packet is lost. 
However, in the event of sequential packet loss, additional packet information may be 
unrecoverable. Because modem relay is highly dependent upon transmission of all packets, it is 
important to provide a data redundancy technique appropriate to the modem relay of the present 
invention. 

When packet loss exceeds a certain value, it is not possible to maintain reliable 
communication using the modem relay of the present invention. Therefore, data redundancy as 
taught herein is implemented. A whole number value k is provided as a repetition count. The 
value must be known by each gateway at each side of the connection and must be the same for 
each gateway. The value of k is negotiated by the gateways and can be dependant upon the 
characteristics of the packet network. A whole number N is provided as the number of new bytes 
in each data packet. Again, both gateways must agree on the size of the new data buffer. 

Each packet is encapsulated with a certain packet format including a sequence number 
uniquely assigned to each packet that is transmitted. The transmitting gateway receives Data 
[LN] in each iteration to be encoded into the data packet. The transmitter encodes the data 
packets with the redundancy taught by the present invention as follows: 
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The receiving gateway decodes the data packet according to the following procedure. 
First the receiving gateway determines the value of D which is equal to the difference between 

15 the sequence number of the currently received data packet and the sequence number of the last 
previously received data packet. If the value of D is equal to one, no packets were lost and the 
receiving gateway need only output the bits of data corresponding to the most recent bits in the 
data packet. If the value of D is greater than one, the receiving gateway must output each set of 
data corresponding to the number of packets equal to the value of D, beginning with the most 

20 recent data packet and proceeding backwards to acquire data packets corresponding to the lost 
packet network packets. 



If the value of D exceeds k, then the value of k should be re- negotiated betv^een the two 
gateway's. First, upon detection of a value of D which exceeds the value of k, the receiving 
gateway reports a loss equal to (D-k)N bytes, the receiving gateway then assigns a value D to 
the value k. By increasing the value of k to equal the actual number of lost packets, the 
redundancy can be adjusted to compensate for increases in packet loss across the packet network. 
Also, the receiving gateway can request a retransmission of the last DN bytes from the 
transmitting gateway to compensate for the packet loss not provision for in the redundancy k. 

Because the receiving gateway calculates the difference in the loss of packets and the 
transmission redundancy, the redundancy can be adjusted. The amount of redundancy can be 
increased or decreased dependant on the current packet loss across the network as detected by 
the modem relay. In this manner, redundancy can be responsive to not only the network loss but 
also the individual network loss experienced in real time by the present modem relay session. 

Because many varying and different embodiments may be made within the scope of the 
inventive concept herein taught, and because many modifications may be made in the 
embodiments herein detailed in accordance with the descriptive requirements of the law, it is to be 
understood that the details herein are to be interpreted as illustrative and not in a limiting sense. 
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